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Abstract 

We introduce and study a new model: 0-automatic queues. Roughly, 0-automatic queues 
are characterized by a special buffering mechanism evolving like a random walk on some 
infinite group or monoid. The salient result is that all stable 0-automatic queues have a 
product form stationary distribution and a Poisson output process. When considering the 
two simplest and extremal cases of 0-automatic queues, we recover the simple M/M/1 queue, 
and Gelenbe's G-queue with positive and negative customers. 

Keywords: Queueing theory, M/M/1 queue, G-queue, quasi-reversibility, product form, Quasi- 
Birth-and-Death process. 
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1 Introduction 

Here is an informal description of a special type of 0-automatic queue (corresponding to a free 
product of three finite monoids) . Consider a queue with a single server and an infinite capacity 
buffer. Customers are colored either in Red, Blue, or Green, with a finite set of possible shades 
within each color: S^j, S^, Sg". In the buffer, two consecutive customers of the same color either 
cancel each other or merge to give a new customer of the same color. Customers of different 
colors do not interact. This is illustrated in Figured! 
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Figure 1: A 0-automatic queue. 

The shades get modified in the merging procedure, according to an internal law: Sj x Sj ^ 
EjU{l}, with 1 coding for the cancellation. The only but crucial restriction is that each internal 
law should be associative. 

We now give a more detailed account of the model and results. Zero-automatic queues may be 
viewed as the synthesis of a simple queue and a random walk on a 0-automatic pair. We first 
recall these last two models. 
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The M/M/l/oo FIFO queue, or simply M/M/\ queue, is the Markovian queue with arrivals 
and services occurring at constant rate, say A and ^, a single server, an infinite capacity buffer, 
and a First-In-First-Out discipline. This is arguably the simplest and also the most studied 
model in queueing theory, with at least one book devoted to it The queue-length process 
is a continuous time jump Markov process and its infinitesimal generator Q is given by: Vn E 
iNi, Q{n,n + 1) = A, Q{n + l,n) = /x. Under the stability condition X < fj., the queue-length 
process is ergodic, and its stationary distribution vr is given by: 




Besides, and this constitutes the celebrated Burke Theorem, the departure process in equilibrium 
has the same law as the arrival process. 

Let us introduce the a priori completely unrelated model of random walk on a plain group 
studied in [211 E^. 

Let X be an infinite group or monoid with a finite set of generators S. Let u he a probability 
measure on E and let (xi)igN be a sequence of S-valued i.i.d. r.v.'s of law u. Let be the 

sequence of X- valued r.v.'s defined by: Xq = Ix, Xn+i = Xn * Xn = xq * xi * ■ ■ ■ * Xn, where Ix 
is the unit element of X and * is the group or monoid law. By definition, {Xn)n is a realization 
of the random walk {X, v). 

We now assume that the pair (X, S) is formed by a plain monoid with natural generators. The 
definition will be given in Section [2j For the moment, it suffices to say that the elements of 
X can be set in bijection with a regular language Li^X^'Yj^ (Z E*. The random walk i^Xj^yi is 
viewed as evolving on L(X, E). If X„ = ua, a G E, and Xn = b €z E, then 

Xn+i = u if a * 6 = Ix, Xn+i = uc if a * b = c £ T,, Xn+i = uab otherwise . (2) 

Now assume that the random walk is transient. Let z^°°(nE'^) be the probability that the 
random walk goes to infinity in the "direction" u (i.e. i/°°(nE"^) = P{3iV,Vn > A^,X„ G uE*}). 
The following is the main result in |21j : 

Vn = til • • -tin G L(X, E), {uT,'^) = q{ui) ■ ■ ■ q{un-i)r{un) , (3) 

where Va G E, q{a) G (0, l),r{a) G (0, 1). 

The expressions in ([T]) and ^ share a common "multiplicative" structure. Guided by this 
analogy, we want to merge the two models together. To that purpose, we make the following 
elementary observation: if we block the server in an M/M/1 queue, the number of waiting 
customers after n arrivals is An = n. And (^n)n can be viewed as the (not so random) random 
walk on the pair ((INJ, +), {!}) associated with the probability : i^(l) = 1. 

Now, replace the trivial random walk (A„)„ by another, more complex, random walk (X„)„ on 
a plain triple {X, E, u). Hence, the random walk {Xn)n constitutes the buffering mechanism in 
a queue with a blocked server. A 0-automatic queue is the model obtained when unblocking the 
server. The set E is the set of possible classes for customers. Customers arrive at constant rate 
A. Upon arrival, a new customer (class b) interacts with the customer presently at the back-end 
of the buffer (class a), according to ([2]). At the front-end of the buffer, customers are served at 
constant rate 

Let us comment on the name zero- automatic. Plain groups, see ([7]), are automatic in the sense 
of Epstein et. al p2|. Automatic groups form an important class of groups extensively studied 
in geometric group theory, the adjective "automatic" referring to the existence of automata to 
recognize and multiply elements of the group. Now the pairs {X, E) formed by a plain group 
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with natural generators satisfy the 0- fellow traveller property, see |12j . It was proposed in |21j 
to call {X, S) a 0-automatic pair. By extension, a queue built upon {X, S) is 0- automatic. The 
name is also supposed to evoke the local aspect of the interactions between customers in the 
buffer, see 

Let 7 be the drift or rate of escape to infinity of the random walk We prove in Section S] 

that the stability condition for the 0-automatic queue associated with is: A7 < /i. Under 

this condition, we prove in Section that the stationary distribution p for the queue-content 
process has a "multiplicative" structure: 

Vti = til • • -tin G L(X, S), p{u) = {I - p)p^q{ui)- ■ ■ q{un-i)r{un) , (4) 

for some numbers p G (0, 1), Va G S, q{a) G (0, l),r(a) G (0, 1). (These numbers are in general 
different from their counterparts in ([T]) and ([3]).) Furthermore, the departure process from 
the queue is a Poisson process of rate pp. Thus we have an analog of Burke Theorem for all 
0-automatic queues. Using standard terminology, 0-automatic queues are quasi-reversible. 

To be more precise, given several variants of 0-automatic queues can be defined depend- 

ing on the way customers are incorporated in an empty queue (boundary condition). There is 
precisely one choice for which the result in (jH) holds. The numbers p,q{-),r{-), as well as the 
right boundary condition, are obtained implicitly via the unique solution of a set of algebraic 
equations, see Theorems 15.71 and 15.81 for a precise statement. 

Aside from the free monoid, the next simplest example of a plain monoid is the free group 
over one generator: (Z, +). The 0-automatic queues associated with (Z, { — 1, 1}) are variations 
of Gelenbe's G-queues, or queues with positive and negative customers, which were quite ex- 
tensively studied in the 90's, see [21 [T3] and the bibliography in [TB]. General 0-automatic 
queues can be viewed as a wide generalization of this setting. Indeed, in a 0-automatic queue, 
different types of tasks (customers) can be modelled. Let us detail four of them which form a 
representative sample, without exhausting all the types within the realm of 0-automaticity. 

- Classical type. Tasks are processed one by one with no simplification occurring in the buffer: 
aa = aa. The corresponding pair is {hi, {1}) ~ ({a}*, {«})• 

- Positive/negative type. Tasks are either positive (a) or negative (a~^) and two consecu- 
tive tasks of opposite signs cancel each other: aa~^ = a~^a = 1. The corresponding pair is 
(Z, {1, —1}) ~ (F(a), {a, a~^}). The relevance of this type for applications is discussed in [15j. 

- "One equals many" type. It takes the same time to process one or several consecutive instances 
of the same task: aa = a. Think for instance of a ticket reservation where the number of requests 
is only reflected by an integer value in a menu-bar choice. The corresponding pair is (IB,{a}) 
where IB is the Boolean monoid IB = ( a | a^ = a). 

- "Dating agency" type. Two instances of the same task cancel each other: aa = 1. Think of 
a task as being a tennis player looking for a partner (to be provided by the server); when two 
such tasks are next to each other in the buffer, they leave to play a game instead of waiting in 
line. The corresponding pair is (Z/2Z = {a \ a^ = 1 ),{a}). Instead of tennis players, we may 
consider music trio players, bridge players, etc, the corresponding group being Z/3Z, Z/4Z, etc. 

To model a server where several of the above types (and possibly several copies of the same 
type) can be processed, one just has to perform the free product of the corresponding monoids 
or groups (see Section f2.1l for the definition). 

The M/M/1 queue is the basic primitive for building Jackson networks, which have the remark- 
able property of having a "product-form" stationary distribution. More generally, networks 
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made of quasi-reversible nodes tend to have a product form distribution, see for instance [25] . 
In a subsequent work we prove that it is indeed the case for Jackson-type and Kelly-type 
networks of 0-automatic queues. 

A preliminary version without proofs of the present paper has appeared in the conference 
proceedings [8j. 

2 Preliminaries 

Notations. We denote respectively by Z, INJ and the integers, nonnegative integers and reals. 
We denote by IhJ* and IR!j_ the positive integers and reals. The symbol U is used for the disjoint 
union of sets. Given a set T and S C T, define I5 : T ^ {0, 1} by Isiu) = 1 if u £ S and 
l5('u) = otherwise. Given a set T, a vector x G IR-^, and S CT, set x{S) = J2ueS 

Let us recall the needed material on random walks on plain monoids. The presentation follows 
[2IIE2]. 

2.1 Monoids and groups 

Given a set S, the free monoid generated by S is denoted by S*. The unit element is denoted 
by 1 or !■£* . As usual, the elements of S and S* are called letters and words, respectively. The 
subsets of S* are called languages. The length (number of letters) of a word u is denoted by 

Let {X,*) be a group or monoid with set of generators S. The unit element of X is denoted 
by Ix- When X is a group, the inverse of x G X is denoted by x~^. We always assume that: 
Ix S, and in the group case that: x G S =^> x~^ G S. The length with respect to S of an 
element x of X is: 

\x\y, = min{A; \ x = ai* ■ ■ ■ * a^, Oj G E} (5) 

The Cayley graph X{X, S) of X with respect to S is the directed graph with nodes X and arcs 
u — > t> if 3a G S, u* a = V. 

Consider a relation R C T,* x T,* , and let be the least congruence on S* such that u ~ij v 
if {u,v) G R. Let X be isomorphic to the quotient monoid (S*/ We say that ( S | u = 

V, {u, u) G i? ) is a monoid presentation of X and we write X = {Ti \ u = v, {u,v) £ R). 

Given a set S, denote by ¥{S) the free group generated (as a group) by S. Let S""^ be the set 
of inverses of the generators. A monoid presentation of f{S) is 

¥{S) = ( 5 U S"^ I aa-^ = 1, a'^a = 1, Va G 5 ) . (6) 

Given two groups or monoids Xi and X2 , we denote by Xi -k X2 the free product of Xi and X2 . 
Roughly, the elements of Xi*X2 are the finite alternate sequences of elements of and 
X2\{lx2}^ s-iid the law is the concatenation with simplification. More rigorously, the definition 
is as follows. Set S = Xi U X2. The free product Xi -kX2 is defined by the monoid presentation: 

( S I (Vn, f G S*, Vi G {1, 2}), ulxiV = uv, (Va, 5, c G Xi, s.t. c = a * 6), lioftu = ncv ) . 

If Xi and X2 are groups, then Xi -k X2 is also a group. The free product of more than two 
groups or monoids is defined analogously. 

The Cayley graph of the group Z/2Z * Z/3Z is represented on Figure [2] (left). 
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2.2 Plain monoids and groups 

A plain monoid is a monoid X of the form 

X = S** ¥{T) * Xi ★ • • • * Xfe , (7) 

where S and T are finite sets and Xi, . . . ,Xk are finite monoids. A plain group is a plain 
monoid which is also a group. A plain monoid X defined as in ([7]) is a plain group iff = 
and Xi, - ■ ■ , Xk are groups. 

Define 

S = S U T U U Xi \ {IxJ U • • • U Xfc \ {IxJ . (8) 

The set S is a finite set of generators of X, that we call natural generators. Define the language 
L(X, S) C S* by: 

L(X,S) = {ni---nfc I Vi < /c,Mi*ni+i ^ SU{lx}} • (9) 

It is easily seen that the set L(X, S) is in bijection with the group elements. Below we often 
identify X and L{X, S). The following is a consequence of the definition of a plain monoid : 

a,6GS, a*6G SU{lx} ?>*aG SU{lx}. (10) 

To see that (flOl) holds, it is sufficient to check it case by case. It is convenient to introduce the 
sets: Va G E, 

Next(a) = {6GS|6*a^SU {l^}} = {6eS|a*6^SU {Ix}} ■ 

Observe that L{X, S) = {ui • • • | Vi, E Next(tii)} = {ui • • • | V«, Uj+i G Next(iii)}. 

Next property, to be used later on, is another direct consequence of the definition of a plain 
monoid : 

a*6GS =^ Next(a) = Next(6) =Next(a*6) . (11) 

Consider the directed graph of successors (S,— >) where 

a^b if be Next(a) . (12) 
Except in the case X = F(T), |r| = 1, observe that the graph (S, ^) is strongly connected. 

2.3 Random walks on monoids and groups 

Let {X, *) be a group or monoid with finite set of generators S. Let be a probability dis- 
tribution over S. Consider the Markov chain on the state space X with one-step transition 
probabilities given by: Vx G X, Va G S, Px,x*a = v{ci). This Markov chain is called the (right) 
random walk (associated with) {X,i>). 

Let {xn)n be a sequence of i.i.d. r.v's distributed according to u. Set 

Xq = Ix, Xn+l= Xn* Xn= Xq* ■ ■ ■ *Xn ■ (13) 

Then {Xn) „ is a realization of the random walk (X, z^). For all x,y G X, we have |x * yls < 
|3;|e + |?/|e- Applying Kingman's Subadditive Ergodic Theorem yields the following (first noticed 
by Guivarc'h [16j): there exists 7 G IR+ such that 

1^ Is 

lim — - — = 7 a.s and in L^, (14) 

n—foo fi 
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Figure 2: The random walk (l/2'Zi^Z/?>Z, v). 



for all 1 < p < cx). We call 7 the drift of the random walk. 

To illustrate, consider the plain group X = Z/2Z:*rZ/3Z = (a| a^ = l)*(6| 6^ = 1) and 
the natural generators S = {a, 5, 6^ = 6^^}. Let v he a. probability measure on S. On the left 
of Figure El we have represented a finite part of the infinite Cayley graph X(X, S), and the 
one-step transitions of the random walk (X, v) starting from the state ba. On the right of the 
figure, we show the same one-step transitions on the group elements viewed as words of L{X^ S) 
(written from bottom to top). 

2.4 Random walks on plain monoids and groups 

It is convenient to introduce the notion of a plain triple. 

Definition 2.1. A triple (X, S, v) is plain if: (i) X is an infinite plain monoid not isomorphic 
to Z or Z/2Z*Z/2Z; (ii) S is a set of natural generators; (Hi) u is a probability measure whose 
support is included in S and generates X. 

Proposition 2.2. //(X, S,z^) is a plain triple, then the random walk {X,v) is transient. 

If X is an infinite plain monoid with the support of v generating X, there are only two cases 
in which {X,v) is not transient: (1) the triple (Z, {-1, 1}, {1/2, 1/2}); (2) the triples (Z/2Z * 
Z/2Z, {a, 6}, u), for any where a and b are the respective generators of the two cyclic groups. 
Since Z and Z/2Z ■k~I_/21. have been excluded from consideration, then the random walk (X, u) 
is transient, see [H] for details. 

The case X = Z is specific. Some of the results below remain true but not all of them. For 
simplicity, we treat this case separately in ^ 

Define: 

S = {x G I Vi,a;(i) > 0, ^x(i) = 1}, 3 = {x G | \/i,x{i) > 0, ^x{i) = 1} . (15) 

i i 

The Traffic Equations play an essential role in the study of the random walk (X, z^). 
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Definition 2.3. The Traffic Equations (TE) associated with a plain triple (X, S,z/) are the 
equations of the variables (x(a))aeE G IR+ defined by: Va G S, 

x{a) = u{a)x{Next{a)) + J2 ^i^M'i) + E ''^^ K(Nlxt(d)f ^''^ ' ^^^^ 

b*d=a deNext{a) ^ ^ 

b*d=lx 

An admissible solution is a solution belonging to S. 

By multiplying both sides of (|16p by x(Next(6)), we obtain a new set of Equations without 
denominators. With some abuse, a solution r in of this last set of Equations is still called a 
solution of the TE. 

Next result can be easily deduced from the proof of \'21\ Theorem 4.5]. 

Proposition 2.4. Let (X, S,z^) be a plain triple. The Traffic Equations have a unique admis- 
sible solution. 

The interest of Proposition 12.41 is that the harmonic measure and the drift can be expressed as 
a function of the solution to the TE. Define the set C S'^ by 

= {noni • • • Ufc • • • G I Vi G INJ, n^+i G Next(ni)} . (17) 

A word belongs to L°° iff all its finite prefixes belong to L{X, S). The set should be viewed 
as the "boundary" of X. 

Let {Xn)n be a realization of the random walk which is transient by Proposition 12.21 The har- 
monic measure of the random walk is the probability measure on L°° with finite-dimensional 
marginals defined by: 

Vui---nfc G = P{3iV,Vn > iV, X„ G ui---UfcS*} . 

This defines indeed a measure on L°° because the random walk is transient, and because Xn 
and Xn+i differ by at most their last symbol. Intuitively, the harmonic measure gives the 
direction in which {Xn)n goes to infinity. 

For a proof of next result, see [2li Theorem 4.5] and also [22\ Theorem 3.3]. In the specific case 
of the free group, the result appears in [HI [2l], see also the survey [20]. 

Theorem 2.5. Let (X, be a plain triple. Let r = (r(a))ag£ be the unique admissible 

solution to the Traffic Equations. Set q{a) = r{a)/r{Next{a)), for all a G S. The harmonic 
measure of the random walk {X, u) is given by: 

yui---Uk, i^°°{ui- ■ ■UkT.'^) =q{ui) ■ ■ ■q{uk-i)r{uk) . (18) 

The drift of the random walk is given by: 

7 = E z^(a) [?iNextia)) - J] f (6)] . (19) 

aSS b\a*b=lx 

3 The Zero-Automatic Queue 

We first define the 0-automatic queue informally, before doing it formally in Definition 13. 1[ Let 
X be a plain monoid, S be a set of natural generators, and v a probability measure on S. The 
associated 0-automatic queue is formed by a simple single server queue with FIFO discipline 
and an infinite capacity buffer in which the buffering occurs according to the random walk 
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{X,u). It is a multi-class queue (classes S) but the class does not influence the way customers 
get served, only the way they get buffered. 



More precisely, the instants of customer arrivals are given by a Poisson process of rate A, and 
each customer carries a mark, or class, which is an element of S. The sequence of marks is i.i.d. 
of law J/. Upon arrival, a new customer interacts with the customer presently at the back-end 
of the buffer, and depending on their respective classes, say b and a, one of three possible events 
occurs: (i) if b * a = Ix , then the two customers leave the queue; (ii) if 6 * a = c G S, then the 
two customers merge to create a customer of type c; (iii) otherwise, customer b takes place at 
the back-end of the buffer, behind customer a. In the mean time, at the front-end of the buffer, 
the customers are served one by one and at constant rate ^ by the server. To be complete, 
one needs to specify how customers are incorporated when the buffer is empty. Several variants 
may be considered, and we view this "boundary condition" as an additional parameter of the 
model. The resulting flexibility in the definition of a 0-automatic queue will turn out to be a 
crucial point. 

According to the above description, the queue-content (the sequence of classes of customers in 
the buffer) is a continuous time jump Markov process. The more formal definition of the queue 
is given via the infinitesimal generator of this process. 

Definition 3.1 (Zero-automatic queue). Consider a plain triple (X, S,z^). Let L{X,Ti) be the 
set of words defined in Consider r £ "B, see [T5\) . and X,fi£R*^. The 0-automatic queue 
of type {X,T,,u,r, X, fi) is defined as follows. The queue-content {M{t))t(z^^ is a continuous 
time jump Markov process on the state space L{X, S) with infinitesimal generator Q defined by: 
\/u = Un ■ ■ ■ ui G L{X, S) \ UaeE{a}*, 

' Q{u, bu) = \u{b) , V6 G Next{un) 

Q{u,cun-i---ui) = XJ2b\b*u„=c'^i^) ' VcG S\{u„}, 36g S, 6*n„ = c 

Q{u,Un-i---ui) = XY.b\b*u„=lx 

^ Q{u,Un - ■ ■U2) = H 

and, for all a £ such that a € Next(a), and for all n> 1, 

Q{a'',ba'') = \v{b) , "ib e Next{a) 

Q{a^,ca^-') = XZb\b*a=Mb) : Vc G S \ {a}, 36 G S, 6 * a = c (21) 
g(a-,a-i) = f^ + XZb\b*a=ixHb) 

and, finally, the boundary condition is, 

Q(ls*,a) = Xi^ia)r{Next{a)) , Va E S . (22) 

We denote by M/M/(X, S) any 0-automatic queue of type (X, S, i/, r. A, ;u). 

Remark 3.2. The intuition behind the form of the boundary condition is as follows: the buffer- 
content is viewed as the visible part of an iceberg consisting of an infinite word of L°° , see p7p . 
When the buffer is empty, new customers are incorporated depending on the invisible part of 
the iceberg, whose first marginal is assumed to be r. This last point will find an a-posteriori 
justification in Theorem 15.71 

The simplest example of 0-automatic queue is the one associated with the free monoid (INJ,-|-). 
The triple (Z, {— 1, 1}, i^), where u is a probability measure on {1,-1}, is not plain. However, 
it is simple and interesting to generalize Definition 13.11 in order to define a 0-automatic queue 
associated with the free group {Z,+). We now discuss the 0-automatic queues associated with 
(W,+) and (Z,+). 
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The simple queue. Consider the free monoid X = {a}* = {a^,k G INJ} over the single 
generator set S = {a}. Hence, for any A,/U G IR!i_, there is only one possible associated queue: 
(X,T,,u,r, X, fi), where z^(a) = r(a) = 1. By specializing the infinitesimal generator Q given in 
Definition 13 -H we get: Vn G iNi, 

Q(a",o"+^) = A, Q(a"+\a'^) = ;u. 

This is the simple M/M/l/oo FIFO queue with arrival rate A and service rate iJ,. 

The G-queue. Consider the free group X = F(a) = {a^,A; G Z} and the set of generators 
S = {a,a"^}. Let be a probability measure on S such that i/(a) > 0,i'{a~^) > 0. Consider 
r G 23 and A,^ G The 0-automatic queue (F(a), S, i^, r, A, //) has an infinitesimal generator 
Q given by: Vn G N, 

g(a",a"+i) = Xu{a), g(a"+\a") = fi + Xu{a-^) 

Q(a-",a-("+i)) = Az^(a-i), g(a-("+i), a"") = + Az^(a) 
Q(ls*,a) = Az^(a)r(a), Q(ls*,a~^) = Xu{a-y{a-^) . 

This is close to the mechanism of the G-queue, a queue with positive and negative cus- 
tomers introduced by Gelenbe |14[ I15j . With respect to the G-queue, one originality of the 
M/M/{¥{a), S) queue is that negative and positive customers play symmetrical roles. Another 
one is the treatment of the boundary condition. 

Since the triple {¥ (a) , {a~^ , a} , u) is not plain according to Def. 12.11 the above queue is not 
covered by the results in Sections [H and [5l However, part of the results remain true, and we 
come back specifically to this model in Section 16.11 and 16.2.41 

Extension. It is possible to generalize Definition 13.11 in order to define a 0-automatic queue 
of type GI /GI /{X,Yi), resp. G/G/{X,T,). Roughly, the description would go as follows. The 
buffering mechanism is kept unchanged; the sequence of inter-arrival times and classes of cus- 
tomers is i.i.d. (resp. stationary and ergodic); the sequence of service times at the server is 
i.i.d. (resp. stationary and ergodic) and independent of the arrivals. 

3.1 Comparison with other models in the literature 

Under stability condition, we will see that a 0-automatic queue has the "Poisson output" prop- 
erty. Also, a 0-automatic queue is "quasi-reversible", at least in the sense of Chao, Miyazawa, 
and Pinedo [B^, Definition 3.4]. There exist many examples of queues with such properties, see 
for instance Kelly [17J or [6j. However, 0-automatic queues are quite different from the existing 
models. 

Let us detail the comparison with the models in see also [5]. Their model is a wide gener- 
alization of Gelenbe's G-queue with signals, batch arrivals, and batch departures. In a sense, 
0-automatic queues can also be viewed as a wide generalization of G-queues. Other common 
features between the models include: non-linear traffic equations, an output rate different from 
the input rate, and subtle boundary conditions to get a product form. Despite these similarities, 
the models are quite orthogonal. One big novelty of 0-automatic queues is the possibility for 
two customers to merge and create a customer with a new type. The algebraic foundation of 
0-automatic queues is another originality. 

It is also worth comparing the 0-automatic queue with another model for queues introduced by 
Yeung and Sengupta [28j, see also He [18j (the YS model in the following). 
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Figure 3: Effect of an arrival and a departure on the content of the buffer in a 0-automatic 
queue built on the group Z/2Z * Z/3Z. 

A common feature is the structure of the state space : a tree for the YS model (or the cartesian 
product of a tree and a finite set), and a more general tree- like graph for the 0-automatic queue. 
In particular, both models correspond to multiclass queues, and the buffer content is coded 
by a word over the alphabet of classes. Second common feature, the effect of a new arrival is 
either to add, to modify the class of, or to remove, a customer at the back-end of the buffer (in 
the YS model, the removal/modification may affect several customers at the back-end of the 
buffer). Now, and this is the first central difference, departures occur at the front-end of the 
buffer in the 0-automatic queue, and at the back-end in the YS model. Therefore, the former 
is a FIFO queue while the latter is a LIFO queue. We have illustrated the FIFO mecanism 
of the 0-automatic queue in Figure O The second important difference concerns the type of 
results which are proved. In a stable 0-automatic queue, the buffer content has a "product 
form" stationary distribution, see Theorem 15. 7i In the YS model, it has only a "matrix product 
form", see |28t Section 2] and getting the stronger "product form" requires severe additional 
assumptions, see [281 Section 6]. To conclude the comparison, here again, the original flavor of 
the 0-automatic queue comes from the underlying group or monoid structure. It is this algebraic 
foundation which can be accounted for the ability to get the strong product form results. 

4 Stability Condition for a Zero- Automatic Queue 

Throughout Sections S] and El the model is as follows. Let [X, E, u) be a plain triple. Fix A and 
/i in IR^ and r in 23. Consider the 0-automatic queue (X, S, zv, r. A, /x). 

Let M = {Mt)t be the queue-content process, and Q the infinitesimal generator. Next Lemma 
is a direct consequence of the strong connectivity of the graph (S, — >) defined in (fT2]) . 

Lemma 4.1. The process M is irreducible. 

The aim of this Section is to prove Proposition 14.21 which characterizes the stability region of 
the 0-automatic queue. 



10 



Proposition 4.2. Letj be the drift of the random walk (X, i/). We have: 

[A7 < /i] <^=^ M ergodic 

[A7 = fi\ <^=^ M null recurrent 

[A7 > fi\ <^=^> M transient . 



Consider an excursion of M from the instant i = at which it is assumed to leave state Is* , to 
the instant Rm which corresponds to the first return to state Is*- Recall that M is transient 
iff P{Rm = 00} > 0, and ergodic iff E[Rm] < 00. 

It is convenient to use the following representation for M. Let A = {Aq = 0, Ai, A2, ■ ■ ■) where 
(^1,^2)- •■) are the time points of a time-stationary Poisson process of rate A on IR4.. Let 
Na = {NAit))t be the corresponding counting process. Let No = {N£){t))t be the counting 
process of a time-stationary Poisson process of rate ^ on IR_|_. Let X = {Xn)n be a realization 
of the random walk (X, v) viewed as evolving on L{X, E), see (|13p . Assume that A, X, and 
are mutually independent. Let {Xt)t be the continuous-time jump Markov process on the state 
space L{X, S) defined by: 

Xt = Xn+i on [An,An+l) . 

For all t in the interval [0, Rm), we have: 

iM^ls = iXtIs - Noit) . (23) 



Here Xt is the queue-content at time t if no service has been completed. Observe that the first 
letter of Xt corresponds to the front-end of the buffer (the right-end in Figured]), and the last 
letter to the back-end (the left-end in Figure [T]) . 

The counting process of a Poisson process satisfies a Strong Law of Large Numbers. We get, 

lim^ = A, lim^ = M. (24) 

i— >oo t t—>-oo t 



We also have, a.s.. 



lim = 7 



where 7 is the drift of the random walk {X, v). So we have, a.s., 

T \^t\T, v NA{t) ,^ 

lim — = lim - — — X — = A7 . (25) 

n^oo t t^co NAyt) t 

We can now prove the following. 

Lemma 4.3. If Xj < fi then M is recurrent. If Xj > fj, then M is transient. 



Proof. We show the first statement by contraposition. If M is transient then P{Rm = 00} > 0. 
Using (j23j) and ([23]), we obtain that a.s. on the event {Rm = 00}, we have: 

y \Mt\j^ 

lim — - — = A7 — . 
To avoid a contradiction, we must have A7 — /i > 0. 

Now assume that A7 > /i. Using the independence of {Xt)t, and Nd, and the regenerative 
properties of it is easily shown that P{Vt, |Mj|s > 0} > 0. In particular P{Rm = 00} > 
and M is transient. □ 
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To get the stronger results in Proposition 14.21 the idea is to approximate the 0-automatic queue 
by a simple queue with a Markov additive arrival process, and then to use standard results from 
queueing theory. 

Since {Xt)t is transient (Proposition [22]), there exists an a.s. finite Tq such that Vt > Tq, > 
1. For notational simplicity, assume that Tq = 0. Define the random variables: VA; > 1, 

Tk = inf{t \ys>t, > A: + 1}, = Tk+i - Tk . (26) 

The r.v.'s Tk are a.s. finite because {Xt)t is transient, and we have: (Tq = 0) < Ti < T2 < . . . 
a.s. 

By transience, lim^ Xt is a (random) infinite word on the alphabet E, let us write it as limt Xt = 
U0U1U2 ■ ■ ■ ■ By definition, see Section [2l the law of C/1C/2 ■ ■ ■ is the harmonic measure of 
the random walk (X, z^). Observe that: 

X^-=Uo--- Uk-i, Vt >Tk, Xt = Uo--- Uk-iYt, Yt G L{X, S) \ {Is*} . 



k 



According to Theorem 12. 5[ we have: Vuq • • • "Ufc-i G T{X, S), 

r(Next(uo)) r(Next(MA;-2)) 
^ N ^(^i) r{uk-i) .271 

'■^''°V(Next(no)) " ' ' f(Next(n,._2)) ' ^ ' 

It follows that (Uk)k is a Markov chain with initial distribution r and transition matrix P given 
by: 

J f(6)/f (Next (a)) if 6 G Next (a) 
I otherwise 



Vo, fteS, PaJ 



The matrix P is irreducible as a direct consequence of the strong connectivity of the graph of 
successors (S, -^), see (fT2]) . Let vr be the stationary distribution of P characterized by nP = n. 
In general, the Markov chain (Uk)k is not stationary, i.e. r is different from vr. (See \22\ 
Proposition 3.6] for a sufficient condition on {X,iy) ensuring that r = vr.) 

Consider now the sequence {U,t) = {{Uk,Tk))k- A consequence of the above is that {U,t) is a 
Markov chain with transition function depending only on the first coordinate. According to the 
classical terminology, the sequence {Tk)k is a Markov additive process (MAP). 

Consider the simple queue of type MAP/M/1 with arrival process {Tk)k, and a service process 
driven by N. Let {ak)k be the corresponding sequence of service times. We deduce from (|2ll) . 
that a.s. and in L^: 

lim -y^icTi - Ti) = — . 

n^oo n ^-^ U 
i=l 

Let Z = {Zt)t be the queue-length process of this queue. Let Rz be the first instant of return 
to for the process Z. Applying standard results for MAP/G//1 queues, see for instance [21 
Prop. 4.2, Chapter X], we get: 

[A7 < /i] =^ [E[Rz] < 00] (28) 
[A7 = fi] =^ [Rz a.s. finite, E[Rz] = 00] . (29) 

Concentrating on the mechanism of the 0-automatic queue, it is not difficult to see that: 

Tk<Rz< Tk+i] =^ \Tk <Rz< Rm < Tk+i] . (30) 
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Hence, the queue MAP/M/1 is a good approximation of the 0-automatic queue. In particular, 
the two imphcations in ()28|) - (l29p also hold for Rm- In view of Lemma l4.3|. this completes the 
proof of Proposition 14.21 

Remark. The above proof does not rely in an essential way on the Markovian assumption. For 
instance, modulo some care, an analog of Proposition[32]can clearly be written for a 0-automatic 
queue of type GI/GI/{X, S). 



5 Stationary Distribution of a Stable Queue 

5.1 The Twisted Traffic Equations 

The Traffic Equations, see Definition 12. 3^ play a central role in studying the random walk. We 
now introduce equations which play a similar role for the queue. 

Definition 5.1 (Twisted Traffic Equations). The Twisted Traffic Equations TTE associated with 
(X, S, I/, A, ;u) are the equations of the variables (??, x), t] S IRl, x = (x(a))ags S IR5, defined by: 



b*d= 



r]{\ + ij)x{a) = if ^x{a) + \v{a)x{Next{a)) + r]\ v{b)x{d) (31) 

i=a 

xid) 

I — ' 

x{Next{d))' 



deNext{a) 
b*d=lx 

To get a hint of the future role of the TTE, let us examine the case (^, S) = ({a}*, {a}) 
considered at the end of Section [3l Recall that there is only one possible variant for the queue 
M/M/{{a}* , {a}) which is equivalent to the simple M/M/1 queue. By simplifying (I3ip . we get: 

p{X + /u) = + A . (32) 

Compare this with the global balance equations of the M/M/1 queue: 

7r(n)(A + ^) = 7r(n-l)A + 7r(n + l)^. (33) 

By substituting 7r(n) = 7r(0)/9" in we recognize 



According to Proposition 12.41 there is a unique admissible solution to the Traffic Equations, 
that we denote by r = (r(a))agE- We denote by 7 the drift of the random walk {X, v). 
Consider x G "B. Define 

A{x) = Y,^{a) ^(^)' B{x) = ^i^Xb), C{x)= J2 ^{o)x{b). (34) 

qGS feGNext(a) a*f)GS a*b=lx 

One easily checks that: 

A{x)+B{x) + C{x) = l. (35) 

This point was the crux of the argument in proving Proposition 12.41 in [21j . Observe that a 
simple rewriting of p9p gives: 

7 = A{?) - C{?) . (36) 

Let us investigate some properties of the solutions to the Twisted Traffic Equations. 

First, if (p, r) is a solution to the TTE with r G 23, then r belongs to S. This follows directly 
from the shape of the TTE and from the strong connectivity of the graph (S, — >), see ()12p . 
Second, if we set r/ = 1 in the Twisted Traffic Equations ()3ip . and perform the obvious simpli- 
fications, we obtain the Traffic Equations (|16p . It implies that (l,r) is a solution to the TTE 
for all A and /i. 
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Lemma 5.2. Let {p,r), p £ IR!j_,r £'B, be a solution to the TTE. We have either {p,r) = 



or 



Proof. By summing all the Equations of ()31|) . we get: 

p{\ + p) = p^// + A^z^(a)r(Next(a)) + pA ^ v{a)r{h) 



(37) 



deNext(a) ^ ^ 

= pV + AA(r) + p\B{r) + p2AC(r) . 
Replacing B{r) by 1 — A{r) — C{r) in the above, we get: 

{p-l)[{^ + XC{r))p-XA{r)]=0. (38) 



If /> = 1, we have seen that the TTE reduces to the TE, which implies by Proposition 
that {p,r) = (l,f). Otherwise, we must have (// + XC{r))p — XA{r) = 0. This completes the 
proof. □ 

The relevant solutions to the TTE will turn out to be the ones satisfying (j37p . This leads us to 
the next Definition. 

Definition 5.3. A solution {p,r) to the TTE is called an admissible solution if p & IR^, r G S, 
and if Jg?]) is satisfied. 



Lemma 5.4. //A7 = p, then (l,r) is an admissible solution to the TTE. //(l,r) is an admissible 
solution to the TTE, then r = r and A7 = p. 

Proof. Assume that A7 = p. We know that (l,r) is a solution to the TTE. We need to check 
that it is admissible. By definition, it is admissible if: 

1 = ^4^ ^ A (A(f)-C(f ))=/.. 
p + XC{r) 

We conclude by recalling that: 7 = A{r) — C{r), see ([5^ . 

Assume now that (1,?^) is an admissible solution to the TTE. Since p = 1, the TTE reduce to 
the TE implying that r = r . Now replacing (p, r) by (1, r) in ()37p . we get: Xj = p. □ 

More generally, admissible solutions always exist: 

Lemma 5.5. There exists an admissible solution to the TTE. 

Proof. Consider the Equations ([^T]) and replace t] by XA{x)/{p + XC{x)). The resulting equa- 
tions in X can be viewed as a fixed point equation of the type ^(x) = x. The corresponding 
application ^ : (IR;^)^ — > (IR!j_)^ has the following form. For a G S and for x G (IR+)^, 

ciGNext(a) 
b*d=lx 

+X V u{b)x{d) + ^ ^ )'~^}''K {a)x{Next{a)) ] . (39) 
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Consider x G "B. By summing the Equations in ([39]) and using ([35|) . we get: 



= T [XA{x) + XB{x) + + XC{x)] = 1 . 

We have proved that ^'('B) C 23. The end of the proof follows very closely the proof of Theorem 
4.5 in [21j. For the sake of completeness, we recall the argument. 

To use a Fixed Point Theorem, we need to define ^' on a compact and convex set. The set 
S, which is the closure of 23, is a compact and convex subset of IR^. But the map ^' cannot 
in general be extended continuously on "B. More precisely, ^{x),x G 'B\'B, can be defined 
unambiguously iff x(Next(ii)) ^ for all u. 

For X G S\'B, let ^'(x) C S be the set of possible limits of ^'(a;„),a;„ e 'B,Xn ^ x. We have 
extended ^ to a correspondence ^ : "B ^ B. Clearly this correspondence has a closed graph 
and nonempty convex values. Therefore, we are in the domain of application of the Kakutani- 
Fan-Glicksberg Theorem, see PQ Chapter 16]. The correspondence has at least one fixed point: 
3r £ "B such that r G ^'(r). Now using the shape of the Equations in (|39p and the strong 
connectivity of the graph of succesors (S, — >), we obtain that r G B (see ^T] Theorem 4.5] for 
details) . 

Set p = \A{r)/{p + AC(r)). The pair (p,r) is an admissible solution to the TTE. □ 



5.2 The main results 

Next Lemma begins to establish the link between the Twisted Traffic Equations and the queue 
M/M/(X,S). 

Lemma 5.6. Let (/?, r) he an admissible solution to the TTE. Consider the 0-automatic queue 
of type {X,T,,u,r, X, p). Let Qr he the infinitesimal generator of the queue-content process. 
Consider the measure pp^r on L{X, E) defined by: 

Va„ • • • ai G L{X, S), p,,,(a„ ■ ■ ■ a,) = p"— iM- • • • ^M^r(ai) . (40) 

r[Next[an)) r[Next[a2)) 

We have Pp^rQr = 0. Conversely, assume there exist p G IR^ and r G 23 such that the measure 
Pp^r defined by satisfies Pp^rQr = 0. Then {p,r) is an admissible solution to the TTE. 

Proof. We have Pp^rQr = if and only if: Vu G L{X, S), 

^ Pp,r{u)Qr{u,v) = ^ Pp,r{v)Qr{v,u) . (41) 
veL{X,T.) i;eL(X,E) 

Denote the left and right-hand side of the above equality by L and R, respectively. Define 

Noact(a) = {b£^\b*a = a}. 

The left of gl]) is: 

^ ^ 1 EaeE Ai/(a)r(Next(a)) = AA(r) if n = Is- ^ 
1 Pp,r{u){X{l — z^(Noact(a„))) + p) otherwise 

The right of ()4ip is given by, for u = Is* , 

R = Y, Pr{a) [p + X u{h)\ = p{p + XC{r)) , (43) 

aSE b*a=lx 
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and for u = a„ • • • ai , n > 1 , 



R = Xu{an)pp,r{an-i ■ ■ ■ ai) + ^ Xiy{b)pp^r{dan-i---ai) 



d^an 
b*d=an 



+ \u{a)pp^r{han- ■ ■ ai) + ^ pp,r.(a„ • • • ai6)// 



6GNext(a„) 6eNcxt(ai) 
a*b=lx 



Pp,r[an- ■ ■ ai] 



lr(Next(a„)) ^-^ r(d) r(Next(a„)) 
7 — ^ Ai^lar, + > — — —- -. — ^ Az^ 0) 

P r(a„) ^ r(Next((i)) r(o„) ^ ^ 

b*d=an 

E. , , r(6i v-^ 
^^"(" V(Next(b)) + ^(Next(ai)) ^ 

6GNext(a„) f)£Ncxt(ai) 
a*b=lx 



r(6) r(&) 



Now recall that b*deT, =^ Next (6 * d) = Next(d). We obtain: 

-1 r(Next(a„)) / x , r{d) 

7 — \ Ai/(a„ + > — — - 

-P r{an) .-^ r(a„) 



1 r(Next(a„)) X ^(^) 
-R = Pp,r(On • • •«!) 7 — T Ai/(a„) + > ^ — r-Az/(6) - Az^(Noact(a„)) 

r(6) 



V (Next (6)) 

a*b=lx 

We see that for u ^ Is* , the equality L = R '\s precisely equivalent to the fact that (p, r) is a 
solution to the TTE. For u = Is*, the equality L = R is precisely equivalent to the fact that p 
and r satisfy ([37|). 

Therefore, the equality L = R \s precisely equivalent to the fact that (p, r) is an admissible 
solution to the TTE. This completes the proof. □ 

We now have all the ingredients to prove the central results of the paper. 

Theorem 5.7. Let (X, S,z^) he a plain triple. Fix A and fj, in R*^. Let {p,r) be an admissible 
solution to the TTE. Consider the 0-automatic queue {X, S, v, r, A, p,). Denote by = {Mr{t))t 
the queue-content process and by Qr its infinitesimal generator. We have: 

[p < 1] <;=^ [A7 < p] <^=^> [Mr ergodic] 
[p = 1] <;=^ [A7 = p] <^=^> [M^ null recurrent^ 
[p > 1] <^=^ [A7 > fi] <^=^ [Mr transient] . 

Assume that A7 < p. The stationary distribution iip^r of the process Mr is given by: Van • • • ai G 
L(X,S), 

vrp,r(a„ • • • ai) = (1 - p)pp^r{an • • • ai) = (1 - /o)p"g(a„) • • • q{a2)r{ai) , (44) 
where q{a) = r{a) /r{Next{a)) for all a G S. 

Proof. Let {p, r) be an admissible solution to the Twisted Traffic Equations. Let pp^r be the 
measure defined in (jiOl) . We have (using that X]aes'^(") ~ -*-)■ 

^ PpAu) = Y1 PpA^) = X] • 

ueL(X,S) neN nGL(X,S) nSN 

\u\s=n 
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Hence, YluPp^ri^) < cxd iff p < 1. Now recall that Pp^rQr = 0, Lemma [521 It is standard (see 
for instance [U Chapter 8]) that the process Mr is ergodic iff J2uPp,ri'^) < Now, according 
to Proposition 14.21 Mr is ergodic iff A7 < fj,. By combining the three equivalences, we get: 

[p < 1] <S=^ [Mr ergodic ] <S=^ [A7 < fj] . 



The result in (j44|) holds as a direct consequence of Lemma 

Now let us turn our attention to the null recurrent case. Assume that p = 1. Using Lemma EI 
and Proposition 14.21 we have: 

[p = 1] =^ [A7 = p\ <^=^ [Mr null recurrent] . (45) 

Let (p, r) be an admissible solution to the TTE. Using the argumentation in the forthcoming 
proof of Theorem 15. 8t we deduce that we must have p = p = 1. Hence we have an equivalence 
on the left of (H5|) . This completes the proof. □ 



Assume that A7 = p- It follows immediately from Lemma 15.41 and Theorem 15.71 that (l,r) is 
the unique admissible solution to the TTE. We now prove a more interesting result in the same 
vein. 

Theorem 5.8. Consider the same model as in Theorem \5. 7\ Assume that < p. Then the TTE 
have a unique admissible solution. In particular, there is only one variant of the 0-automatic 
queue M/M/{X, S) with a product form distribution. 

Proof. Let (p, r) and (p, f) be two admissible solutions to the TTE. According to Theorem l5.7l 
we have p < 1 and p < 1. Let vr and vr be the respective stationary distributions of Mr and Mf. 

We now use a classical result on ergodic Markov processes, cf for instance [H Chapter 8, Theorem 
5.1]: the stationary distribution is proportional to the time spent in each state in an excursion 
of the process from s to s, for some arbitrary state s. 

Assume that the queue-content is Is* at instant 0. Let T, resp. T, be the first instant of jump 
of Mr, resp. Mf. Let R, resp. R, be the first return instant to Is*- We have, for all u G L{X, S) 
(~ stands for 'proportional to'), 



i-R j-R 

E[ t{Mr{t)=u}dt], 7r{u) E[ l{Mfit)=u}dt] . 
Jo Jo 

It follows that, for all u € L{X, S), u ^ Is*, 

t-R nR 

E[ t{Mr{t)=u}dt], ^{u)r^E[j t{Mf{t)=u}dt\ . 
Jt Jf 



vr Ui ~ 



And, conditioning by the value of Mr(T), resp. Mf{f), we have, for all u G L{X, S), u / Is*, 

rR 



'^{Mr{t)=u}dt\ 

I'R 

~ ^z^(a)f(Next(a)) t{Mf{t)=u}dt\ . 



Observe that the generators Qr and Qf differ only in the line indexed by Is*- In other terms, 
the conditional law of (Afr(t))(g[x'^/j] on the event {Mr{T) = a}, is equal to the conditional 
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law of (Mf:(t))^gjj, on the event {Mf{T) = a}. Therefore vr and vf are obtained as hnear 
combinations of the same measures pa defined by: 



pR f-R 

Pa{u) = E[t{Mr{T)=a} ^{Mr{t)=u}dt\ = S t{Mf(i)=u}dt\ . 

For n G INJ*, set 7r(n) = vrju G L(X, S) | = n}. Define 7r(n) and Pa{n) accordingly. Using 
the above, we have, for all n G iNi*, 

^("-) ^ t^(Q)r(Next(a)) Pa{n), n{n) ^ i^(a)f(Next(a)) Pa{n) . (46) 

Besides, according to (jM]), we have 7r(n) ~ and 7r(n) ~ p". In view of (jl6]) . we conclude 
easily that we must have p = fi- 
ll remains to prove that r = r. Let us first show that: 

[Va G S, q{a) = q{a)] =^ [Va G S, r(a) = r{a)] . (47) 

We have: Va, g(a) = r(a)/r(Next(a)). We can reinterpret this as: Mr = r, with r being viewed 
as a column vector and with M being the matrix of dimension E x S defined by: 



Va,6GS, Ma^b 



q{a) if 6 G Next (a) 
otherwise 



Consequently, the matrix M is irreducible. Now invoking the Perron-Frobenius Theorem, since 
r has all its coordinates positive, it implies that r is necessarily the Perron eigenvector of the 
matrix, i.e. the unique (up to a multiplicative constant) eigenvector associated with the spectral 
radius. But we also have: Mr = f, and X^a'^C") ~ X]a^(^) ~ -^y uniqueness of the Perron 
eigenvector, we conclude that r = f. 

Therefore, it remains to prove that: Va G S, q{a) = q{a). Define C{X,T,) C L(X, S) by: 

C{X, S) = {lii • • • life G L{X, S) I ui G Next(nfc)} . 
Observe that: [u G C{X,^)] =^ [Vn, n" G C(X,S)]. 

For u = ui ■ ■ ■ Uk £ C{X, S), set q{u) = q{ui) ■ ■ ■ q{uk)- Define q{u) analogously. Using (fUl) . we 
have, for all n G iNi*, for some constants Ci, C2, 
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;u") = C7ip"l«l5^g('u)"r(Next(nfc)), ^(u") = C72p"l"l^g(u)"f (Next('Ufc)) . (48) 



Besides, 7r(u") = C3 ^^^^^ i^(a)r(Next(a))pa(u") and 7f(n") = C4 ^^^^ ^('^)^(^6^t(^))?'a(^"')! 
for some constants C3, C4. Therefore, 7r(n") and 7r(n") must grow at the same exponential 
speed as a function of n. In view of (j48p . we must have: 

g(ui) • • • g(nfc) = q{ui) • • • q{uk) ■ (49) 

For the remaining step, the argument depends on the form of X. Set X = Xi-k- ■ ■-kXK*XK+i-*:F, 
with Xk+1 = S|^_^]^(|Si^+i| > 0), with F = ¥{T,k+2) i\'^K+2\ > 0), with Xi being finite 
monoids for 1 < i < K , and with S = '^fl_^2 ^i<i<K+2 ^i, = {^i\{^Xi}) for 1 < i < K . 
For a e T.i, 1 < i < K, Next(a) = S \ Sj. For b G T.k+i, Next(6) = S. For c G T.k+2, 
Next(c) = S\{c-i}- 

We first treat the case + |S7^_|_2| > 1- Then there exists i G {K + 1, K + 2} such 

that > 1. Set Gen = Y^k+i U Yk+2 U ^7^+2- ^ Gen, a G Next (a), so we have 
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q[aY = q{a)'^- It implies that q{a) = q{a). Consider 6 G S \ Gen and a £ Gen, one has 
b £ Next(a), so, according to (fi9ll . q{b)q{a) = q{b)q{a). Hence, q{b) = q{b). So q{c) = q{c) for 
all c G S. 

We now consider the case |Sj^+i| + |Ei<-+2| = 0. Assume that K > 3. Consider a G Si, 6 G 
S2,c G S3. We have: Next(a) = S\Si, Next(6) = S\S2, and Next(c) = S\S3. Therefore, 
abc G C{X,'E) and be G C{X,T,). Using (fi9l) . we deduce that: q{a)q{b)q[c) = q{a)q{b)q{c) and 
q{b)q{c) = q{b)q{c). We conclude that q{a) = q{a) for all a G S. 

Assume now that K = 2. The above argument does not work anymore. First of all, we want 
to prove that: 

V7 ^ V ^(°) ^(«) frin\ 

^) = H^)- ^''^ 

Consider a,6 G Si and c G S2. We have: Next(a) = Next(6) = S2 and Next(c) = Si. Hence, 
ac G C(X, S) and be G C(X, S). Using (09]), we have: q{a)q{c) = q{a)q{e) and q{b)q{e) = 
q{b)q{e). It implies that: q{a)/q{b) = q{a)/q{b), which is equivalent to (f50]) . Set R{a) = 
r{a)/r{T.i) = f{a)/r{T,i) if a G Sj. 

Now let us sum the TTE corresponding to all the elements of Si, and let us perform the 
simplifications implied by (jSUp . For instance for {p,r), we get: 

p(A + ^)r(Si) = />V(Si) + Az.(Si)r(S2)+pA ^ iy{a)r{b) 

6*d=lj(-2 

= pV(Si) + Ai/(Si)r(S2) + pAr(Si) ^ i/(a)i2(6) 

+ p2Ar(S2) z.(6)i?(d) 

6*fi=ljf2 

Set Bi = Ea*6eSi v{o)R{h) and C2 = Ea.feeSa, a*6=i^2 v{a)R{b). Using that r(S2) = l-r(Si), 
we get: 

) = AKSi)+/^^AC2 

^ p(A + - + Ai^(Si) - pASi + p2AC2 ■ 

But all the terms in the right-hand side of (|5ip are unchanged when we write the corresponding 
equation for r. So, r(Si) = r(Si). In view of (fSO]) . we deduce that r(a) = f(a) for all a G S. 
This completes the proof. □ 

When the triple is not plain, the TTE may have several admissible solutions. This is for instance 
the case for the triple (F(a), {a, a~^}, {1/2, 1/2}) as discussed in Section [6.2.41 

Remark 5.9. In the case /? < 1, if the boundary condition is chosen according to r', where {p, r') 
is not a solution to the TTE, then the stationary distribution of M^i exists (Prop. 14. 2p . But we 
do not know how to compute it exactly. See Remark 13.21 for a justification of the form of the 
boundary condition. 

Poisson departure processes. 

The celebrated Burke Theorem states that the departure process from a stable M/M/1 queue 
is a Poisson process of the same rate as the arrival process. A nice consequence of Theorem 15.71 
is that an analog of Burke Theorem holds for 0-automatic queues. 
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In a 0-automatic queue, 'departures' occur both at the front-end and at the back-end of the 
buffer. Here we consider only the front-end departures, i.e. the ones corresponding to service 
completions and not to buffer cancellations. 

Let M = {M{t))t be the queue-content process of some 0-automatic queue M/M/{X,T,). A 
departure is an instant of jump of M corresponding to a jump of the type: u„ • • • ui ^ u„ • • • n2 
for u = Un - ■ -ui € L{X, S) \ {Is* }. When u = a", a E S, n > 1 (the case (|2ip in Definition 13. 
some special care must be taken. The jumps of type a" — > a"""^ which are departures occur at 
rate fi. The departure process is the point process of departures. 

Theorem 5.10. The model is the same as in Theorem \ 5. 7\ Assume that A7 < /i. Let {p,r) 
be an admissible solution of the TTE. Consider the 0-automatic queue (X, S, j^, r. A, //). The 
stationary departure process is a Poisson process of rate pfx. Furthermore, for all t, the queue- 
content at time t is independent of the departure process up to time t. 

Proof. The simplest proof of Burke Theorem uses reversibility and is due to Reich, see for 
instance [TT] for details. Here, the argument is similar. 

Let Mr be the stationary queue-content process. Its marginal distribution at a given instant is 
TTp^r given in ()44p . Let D be the corresponding departure process. By definition, the instanta- 
neous rate of D is c{t) = if Mr{t) ^ Is* and c{t) = otherwise. 

Now let us consider the time-reversed point process D. The process D corresponds to the 
instants of "right-increase" of the time-reversed process {Mr{t))t. Therefore, the instantaneous 
rate c{t) of D is as follows. If Mr{t) = a„ • • • ai G L{X, 



^ 7rp,r(an • • • aia) _ pr{a) 

agNext(ai ) 

and if Mr{t) = Is*, 



7rp^r[an---aia ^ pr[a 

agNext(ai) aGNext(ai) 



We conclude that D is a Poisson process of rate pp. Since Poisson processes are preserved by 
time-reversal, D is also a Poisson process of rate pp. 

Also, using the Markov property of Poisson processes, Mr{t) is independent of the process D 
after time t. Under time-reversal, this translates as: Mr{t) is independent of the departure 
process D up to time t. □ 

Here are some additional comments on Theorem 15.101 

1- The infinitesimal generator of the time-reversed process Mr is certainly not the infinitesimal 
generator of a 0-automatic queue. This was already the case for the G-queue. But this is in 
contrast with the situation for the M/M/1 queue. 

2- For a G S, the departure process Da of customers of class a is not a Poisson process. 

3- Equation (j52|) corresponds to the condition defining "quasi-reversibility" in Chao, Miyazawa, 
and Pinedo [6, Definition 3.4]. 

4- The saturation principle of Baccelli and Foss [3j holds for many classical queueing systems. 
Here is a rough description of it. 

Consider a queueing system with an infinite capacity buffer. Let po be the departure rate in 
the saturated system in which an infinite number of customers are stacked in the buffer. Now, 
if the actual arrival rate in the system is X < po, then the system is stable, and the departure 
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rate is A. A dual presentation of the same principle is as follows. Let Aq be the growth rate of 
the buffer in the blocked system where the server has been shut down. If the actual service rate 
in the system is fi > Aq, then the system is stable, and the departure rate is Aq. 
Zero-automatic queues do not satisfy the saturation principle. This can be viewed on the 
following inequalities (to be deduced from Theorem I5.1U|) : 

where: pfi is the actual departure rate in equilibrium, p is the departure rate from the saturated 
system, and A7 is the growth rate of the buffer in the blocked system. 



5.3 Quasi-Birth-and-Death processes 

Quasi-Birth-and-Death (QBD) processes appear naturally in the modelling of several queueing 
and communication systems. As such, they have been extensively studied, see for instance the 
monographs [191 123j . The results in Section [5.21 can be put in perspective by considering the 
relation between 0-automatic queues and QBD processes. 

To that purpose, we define an "approximated" and quite simplified version of the 0-automatic 
queue. The idea is to keep track of the queue-content only through the number of customers 
and the class of the back-end customer. Clearly a difficulty arises: if a cancellation occurs at 
the back-end of the buffer, there is no way to retrieve the class of the new back-end customer. 
This missing information is compensated as follows: the class is chosen at random according to 
the relevant conditional law. 

Consider a 0-automatic queue. The notations and assumptions are the ones of Theorem 15.71 
In particular (p, r) is an admissible solution to the TTE. We assume that A7 < p- Recall that 
Qr is the infinitesimal generator of the queue-content on the state space L{X, S), and that vTp^j. 
given by (j44|) is its stationary distribution. 



Consider the application: 



/: 

tin • • • Ul 

Is* 



{0} U (H* X S) 

{n,Un) 





Define the infinitesimal generator Qr on the state space {0} U (iNi* x S) by: 



Qrix,y) 



E 



vr 



p,r 



(n) 



p,r 



^ Qr{u,v) . 



(53) 



For instance, we obtain by using (|44p and simplifying: 



Qr{{n,a);{n - l,b)) = X ^ u{c) 

c*a=lx 



r{b) 
r(Next(a)) 



{beNext(a)} 



Define a total order on {0} U (N* x S) as follows: is the smallest element and (n, a) < {m,b) 
if n < m or (n = m,a ^ b), where ^ is some total order on S. A couple of lines of computation 
enable to check the following. If lines and columns are ranked according to the above order, the 
infinitesimal generator Qr is block tridiagonal of the form: 

A{r) \ 

Ai 

A2{r) 



Qr 



( a 
B 











^0 

Ai 
A2{r) 








V 



(54) 
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where a is of dimension 1x1, A{r) is of dimension 1 x S, i? is of dimension S x 1, and 
Aq, Ai, A2{r) are of dimension S x S. Furthermore the entries of B,Ao,Ai can be expressed 
in function of A, /i, and v; and the entries of A{r), A2{r) can be expressed in function of A, fi, u, 
and r. 

According to the terminology in Neuts p3] , Qr is the infinitesimal generator of a QBD process 
with a complex boundary behavior. For any such ergodic process, the shape of the stationary 
distribution is known, see for instance [231 Chapter 1.5]. So we assume that Qr is ergodic and 
we apply the general results to get the stationary distribution tt: 

i(0) =y, Vn > l,Va G S, n{n,a) = (a;i?"~^)(a) , (55) 

where 

'Ao + RAi+R'^A2{r) = 

< ay + xB = 0, yA{r) + x{Ai + RA2{r)) = . (56) 

^y + x(/-i?)-i(l,...,l)^ = l 

In ()56p , i? is a matrix of dimension S x S and is the minimal nonnegative solution to the first 
Equation. The pair {y,x), where y is a scalar and a; is a line vector of dimension E, is the 
unique positive solution to the second and third Equations. 

The stationary distribution tt in ()55p has a matrix product form. This matrix product form is 
said to be a product form (this is called Level-Geometric with parameter in [lOj) if: 7r(n,a) = 
r/"~"'^7r(l, a) = r]^~^x{a), for some rj G (0, 1). Clearly, a necessary and sufficient condition for this 
to hold is: xR = rjx. Assume that this last equality holds. By multiplying the first Equation in 
(f56l) by X, and by simplifying the Equations, we get: 

'x{Ao + r]Ai + 7/2^2 (r)) = 

< ay + xB = 0, yA{r) + x{Ai + r]A2{r)) = . (57) 
,y + (l-7?)-ix(l,..., 1)^ = 1 

Now let us replace x hy cr,c G IR, and r/ by p in (I57p . The first Equation yields precisely 
the Twisted Traffic Equations (|3ip for the pair (/O, r). The other two Equations yield exactly: 
y = 1- p, c = p{l- p). 

We conclude that the stationary distribution of Qr is given by: 

n{0) = l-p, Vn > l,Va e S, i(n,a) = (1 -/j)pV(a) . (58) 

This is coherent with the form of vTp^,. as given in ()44p . So the above provides an a-posteriori 
and partial justification for the shape of TTp^r It also provides another light on the central role 
of the TTE. 

It is classical in QBD theory [19\ [TOj to modify the boundary condition to get a stationary 
distribution of product form. Here the situation is more complex since not only the boundary 
condition, but also the A2 matrix, are modified in the quest for the product form. 
Observe also that the result in Theorem 15.71 is much deeper than the one in ()58p . In particular, 
there is a-priori no way to retrieve the result on Qr from the one on the simplified generator 

Qr ■ 

6 Extension and Examples 

6.1 Zero-automatic queues built on 0-automatic pairs 

All the results in Sections U] and are derived for queues built on plain monoids not isomorphic 
to Z (Definition 12. ip . However, the 0-automatic queue built on Z is interesting in itself (it 
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corresponds to Gelenbe's G-queue, see Section [3]) and exhibits new phenomena. It is therefore 
worthwhile to determine the subset of the above results which remain true for this queue. 

In fact, we define a more general framework, and the notion of 0-automatic triples extending 
the plain triples of Definition 12.11 

Let (X, *) be a group or monoid with set of generators S. Denote by vr : S* ^ X the monoid 
homomorphism which associates to a word oi • • • of S* the element oi * • • • * of X. A 
language L of S* is a cross-section of X if the restriction of vr to L is a bijection. The inverse 
map ^ : X ^ L \s then called the normal form map. Define the language L{X, S) C S* as in 
([9]). Define the sets: Va G S, 

Left(a) = {6g S I 6*a ^ SU{lx}}, Right(a) = {6 G S | a * 6 ^ S U {Ix}} • (59) 

In the case of a plain monoid with natural generators, we have Left = Right = Next, see (jlOp . 

Definition 6.1. Let {G, *) be a group with finite set of generators S. We say that the pair (G, S) 
is 0-automatic if L{G, S) is a cross-section of G. 

Such pairs were first considered by Stallings [26] under another name. It can be proved using 
the results from Stallings that G is necessarily isomorphic to a plain group. However the set S 
may be larger than a natural (see Section 12. 2|) set of generators of the plain group. 

Now let us extend the notion to monoids. To get good properties it is necessary to choose a 
more complex definition proposed in [21j. 

Definition 6.2. Let (M, *) he a monoid with finite set of generators S. Assume that L{M,Ti) is 
a cross-section. Let $ : M ^ L{M, S) be the corresponding normal form map. Assume that: 
yu G M s.t. ^{u) = ui • • • Uk, Va G S, 



ni • • • Uk-i if Uk * a = Im ( U2---Uk if a * ui = Im 

$(n*a) = ^ ui ■ ■ ■ Uk-iv if Uk * a = V G H , ^>(a*n) = < vu2 ■ ■ - Uk if a* ui = v G H, 
ui • • • Ufcffl otherwise aui • • - Uk otherwise 

(60) 

Assume furthermore that : Va, 6 G S such that a * 6 G S, 

Left{a * 6) = Left{a), Right{a * b) = Right{b) . (61) 
Then we say that the pair (M, S) is 0-automatic. 

In the group case M = G, the conditions (|6U|) and (|61|) are implied by the fact that the language 
L{G, S) is a cross-section. 

The pairs formed by a plain monoid and natural generators are 0-automatic. However, in 
contrast with the group case, plain monoids do not exhaust the family of monoids appearing 
in 0-automatic pairs. For instance, (M = {a,b \ ab = 1), {a, b}) is a 0-automatic pair, but the 



monoid M is not isomorphic to a plain monoid. This example is studied in Section 16.21 

Definition 6.3. A triple (X, S,i/) is said to be 0-automatic if: (i) (X, S) is a 0-automatic pair 
with X infinite; (ii) v is a probability measure whose support is included in S and generates X. 

Any plain triple, see Def. 12.11 is 0-automatic. Observe that (X, v) may not be transient in 
a 0-automatic triple. Also the graph of succesors (S,^) defined in (|12|) may not be strongly 
connected. 
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Consider a 0-automatic triple (X, S,z/), A,^ G IR!j_, and r £'B, see p^ . The 0-automatic queue 
of type (X, S, I/, r, A, ^) is defined exactly as in Definition 13.11 

The definition of the Traffic Equations gets modified as follows : 



b*d=a (iGLeft(a) 
b*d=lx 



x{a) = u{a)x{Riglit{a)) + u{b)x{d) + ^ i.(6)_^l_x(a) . (62) 



The definition of the Twisted Traffic Equations is modified as well : 

r]{X + IJ,)x{a) = r/^/ix(a) + Az^(a)x(Right(a)) + T^A ^ i'{b)x{d) (63) 



b*d=a 

Va V z.(6) ,J^!^L,, x(a). 

. V ^x(Right(d)) ^ ^ 

We use the convention described after ()15p to define a solution to the TTE belonging to 

The TE do not necessarily have a unique solution, in contrast with Prop. 12.41 The TTE as well 
do not necessarily have a unique solution, and a solution r S 53 to the TTE does not necessarily 
belong to 23 . This is in contrast with Theorem 15.81 

An analog of Lemma f5 . 21 holds : if (p, r), r G "B, is a solution to the TTE then either (p, r) = (1, r) 
and r is a solution to the TE, or 

\A(r) , , 

'=VTmFy '''' 

We can now state the following result. Observe in particuler that there may be several variants 
(corresponding to different r's) of the 0-automatic queue with a product form. 

Proposition 6.4. Let (X, S,zv) be a 0-automatic triple. Let {p,r),r £ "B, be a solution to the 
TTE satisfying ( |6'^[ ). Assume that: Va G S, [r{a) > 0] [r{Right(a)) > 0]. Define 

S = {a G S I r(a) > 0} and L = L{X, S) n S*. 

Consider the 0-automatic queue of type (X, S, z^, r, A, /i). Let Qr be the infinitesimal generator 
of the queue-content process Mr- Consider the measure pp^r on L defined by: 

Va„...aiGL, " " " «i) = P r{mght{a^)) ' ' ' r(ffig/.^(a,)) ^^"^^ " ^''^ 

We have Pp^rQr = 0. Besides, we have: 

[A7 < /i] =^ [p < 1] =^ [Mr ergodic on L ] 
[A7 > /x] =^=- [p > 1] =^ [Mr transient on L ] 

When A7 < /i, the stationary distribution of Mr is TTp^r = (1 ~ p)pp,r- The corresponding 
stationary departure process is a Poisson process of rate pp. 



The proofs of Lemma l5.6l Theorem 15.71 and Theorem 15. lUI are easily adapted to get Prop. EI 



6.2 Five illustrating examples 

We study five particular 0-automatic queues to illustrate the above results. We focus on three 
aspects: (a) the stability region; (b) the value of the load p; (c) the existence of several stationary 
regimes (for the queues built on 0-automatic triples instead of plain triples). 



24 



When the model is simple enough, the TTE can be solved explicitly to get closed form formulas 
as for Z/3Z *Z/3Z below. In all cases and like any set of algebraic equations, the TTE can be 
solved with any prescribed precision. 

Another goal is to convey the idea that 0-automatic queues ought to be pertinent in several 
modelling contexts, due to the flexibility in their definition. The five examples below should be 
interpreted having in mind the different "types" of tasks detailed in the Introduction (classical, 
positive/negative, "one equals many", and "dating agency"). 



6.2.1 The free product Z/3Z*Z/3Z 

Consider the plain triple (Z/3Z*Z/3Z,S = {a, a^, 6, 6^}, i/), where i^(a) = iy{b) = p, iy{a^ 
u{b^) = q= 1/2 -p,pe (0,1/2). 

In [521 Section 4.2], the drift is computed, it is given by: 

1 1 



7 = -4 + 4^16^2-8^ + 5. 

According to Theorem 15.81 iii stable case, the associated TTE have a unique admissible 
solution that we denote by {p,r). Solving the TTE, we get that: 

^^"^ = '^^^ = 4(4Ap^ -2Xp + ^. + X) = A{-4pgX + A + /.) ' r{a ) = r{b ) = - - ria), 

4A V - 2A2p + A^ + A2 

p = 2- 



4A V - 2A2p + 4A/i + A2 + 4/^2 ' 




0.1 0.2 0.3 0.4 0.5 



Figure 4: Z/3Z*Z/3Z: The stability region (left) and the load p (right). 

In Figured] (left), we show the stability region of the queue. The abscissa is p and the ordinate 
is X/p. In Figure m (right), we plot the load p as a function of p and t = X/p, for p G (0, 1/2) 
and X/p G (0, min(l/7, 6)). Hence, p is always smaller or equal to 1, see Theorem 15.71 
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6.2.2 The free product N ★ B 



Consider the plain triple ({a}* * ( 6 | 6^ = 6 ),S = {a,b},u), where z^(a) = p, v{h) 
p G (0, 1). In Figure O we illustrate the corresponding buffering mechanism. 



P, 



I- IDI 



j y j 



IDI 



IDI 



I 



Figure 5: The queue M/M/{bi -k IB, S) with a in white and b in dark gray. 

The unique solution f of the TE is: r(c) = p, r{b) = 1 — p. The drift of the random walk is 
7 = (2 - p)p- 

According to Theorem l5.8l the associated TTE have a unique admissible solution that we denote 
by (/O, "t). Solving the TTE, we obtain that p is a solution of f(Y) = 0, where: 

f{Y) = fi^Y^ + (/i^ + + Xfip)Y^ + (A^p + Xfip)Y - aV + A^p . 
The relation between r(6) and p is given by: p = [r(6)(l — p) +p]X/p. 




a 0.2 0.4 0.6 0.8 1 



Figure 6: IhJ * B: The stability region (left) and the load p (right). 

In Figure El (left), we show the stability region of the queue. The abscissa is p and the ordinate 
is X/p. In Figure [6] (right), we plot the load p as a function of p and t = X/p, for p G (0, 1) and 
X/p G (0, min(l/7, 3)). Hence, p is always smaller or equal to 1, see Theorem 15.71 

6.2.3 The free product INJ * Z ★ B 

Consider the queue associated with the plain triple ({a}**F(6)*(c | = c), S = {a, b, b~^,c}, v) 
where y{a) = p, v{b) = v{b~^) = q/2, and u{c) = 1 — p — q with p,q,p + q G (0, 1). 
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Figure 7: Stability region of the M/M/l/(lNJ ★ Z * B, S) queue. The axis are p, g, and A/^. 



The unique solution r of the associated TE is 



Applying Theorem 12.51 the drift of the random walk is given by: ^ = p + {1 — p — q){l — r(c)) + 
— 2r(6)). Prom there, we obtain Figure[71 the stability region is the region below the surface. 



6.2.4 The free group Z and the free product N ★ Z 

Consider the 0-automatic queue (F(a), {a, a~^}, v, r, A, /x), where z/ is a non-degenerate probabil- 
ity measure on S = {a, a~^}. In Figure El we illustrate the corresponding buffering mechanism. 
Such a mechanism is similar to the one of Gelenbe's G-queue. 



I- 




D 



Figure 8: The M/M/l/(F(a), S) queue with a in light gray and a in dark gray. 

The underlying triple (IF(o), {o, a^^}, u) is not plain (Def. 12. ip . but it is 0-automatic (Def. 16. 3|) . 
Here the graph of successors (S, — >), see (fT2]l . is not connected. Also the random walk {X, v) is 
not transient but null-recurrent when ^{a) = z^(a~^) = 1/2. 

The drift of the random walk is easily computed: 

7 = k(a) - ■ 

Assume first that z/(a) = v{a~^). Solving the TTE, we get that (A/(2/x + A),r) is a solution 
for all r G S. It means that the queue is stable and has a product form distribution under any 
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boundary condition. This interesting behavior can be traced back to the fact that the random 
walk (X, z^) is not transient. 

Assume now that v{a) ^ z^(a^^). There are 2 possible solutions for the TTE: 

{Pi,n) = ( (1, 0)) , {p„r,)= (4tt\= • (66) 

The two solutions correspond to extremal values for r, it means that in the buffer, there is only 
one type of customer with probability 1: if ri = (1, 0), there is only a in the buffer; if r2 = (0, 1), 
there is only in the buffer. Here we recover a model very close to the classical G-queue. 

Set p = inm{pi, P2} and p = max{pi, P2} and define r and f accordingly. We have: 

p<l, [p<l\^ [A7 < p] . 

The stationary distribution of the 0-automatic queue (F(a), S, z/, r, A, p) is: 

vr.(ls* ) = 1 - P , vr,(x") = (1 - p)p" , Vn > 1, (67) 

where x = a if i^(a) < ^{a^^), and x = if ^{a) > i^(a^^). When A7 < p, the 0-automatic 
queue (IF(a), S, z^, f, A, p) also has a product form stationary distribution of the form ()67p with 
p instead of p. 

Consider now a boundary condition r € S. In particular, r 7^ ri, r 7^ r2, so the stationary 
distribution is not of product form. However, if A7 < p, the stationary distribution iTr can still 
be determined explicitly by solving the global balance equations. It is given by: 

vr.(lEO = (l + r(a)-^ + r(a-i)-^)'' 
7r,,(a") = ^,(lsOK«)P?, vr,(a-") = 7r,(ls*)Ka"')P2 , (68) 

where /?i and p2 are defined in (I66p . The expression in (I68p is "almost" of product form. So, 
why do we prefer an expression like the one in (|67p ? The point is that the departure process 
associated with a stationary distribution of type (f68l) is not Poisson, as opposed to the one 
associated with (f67|) . And having a Poisson departure process is crucial to build product form 
networks, see [0]. 

To summarize, when A7 < p, there are two variants of the 0-automatic queue with a product 
form. We would like to argue that one of the two makes more "physical" sense. 

To that purpose, consider the plain triple (F(a) -k {c}*,{a,a~^,c},i') with < u{c) <^ 1. Ac- 
cording to Theorem 15.81 there exists a single variant of the queue with a product form. Let p 
be the corresponding load. The question is to determine which one of the two solutions in ()66p 
is recovered when letting z^(c) go to 0. 

Since the TTE are difficult to solve explicitly, we content ourselves with numerical evidence. In 
Figure m we plot p, p, and p as functions of X/p, for i/(c) = 0.01 and i^(a) = p = 3/5. We see 
that p tends to the larger solution p. The two vertical lines correspond to the stability regions. 
They have an abscissa equal to the inverse of the drift 7"^ for the random walk on F(a) -k {c}* 
and F(a) respectively. 

6.2.5 The monoid M = {a,b\ab=l) 

Consider the bicyclic monoid M = {a,b \ ab = 1 ). Here we have a new "type" of tasks. It 
is close to the positive/negative type but with no symmetry between the positive and negative 
customers. 



28 




Figure 9: F(a) and F(a) * {c}*: the loads as a function of A/^. 



Consider the triple (M, E = {a, b}, i^), with zv(a) = p £ (0, 1), z/(6) = 1 — p. It is a 0-automatic 
triple but not a plain triple. In particular, the graph of successors (S,^) is not strongly 
connected. 

The drift of the random walk is easily computed and given by 7 = |1 — 2p|. Solving the 
associated TTE, we obtain that there is one solution if p < 1/2 and two solutions if p > 1/2. 
More precisely, these two solutions are: 

ta.'-0=(^;(M)).vp 

te,.,)=(__^;(^,i^)),itp>l/2. 

\/i + A(l-p) ^ p P J 

We have: 

ifp<l/2, [pi < 1] ^ [A7 < /i] 

if p > 1/2, pi < 1, [p2 < 1] ^ [A7 < p] . 

In Figure [TOl we show the solutions to the TTE as a function of p and A//i. 

To discriminate between {pi,ri) and {p2,r2), we proceed as for F(a). Consider X = { a,b \ 
ab = 1) -k {c}* . Set i>{a) = p, u{b) = q, v{c) = 1 — p — q with p,q > 0, p + q < 1. The triple 
{X, {a, b, c}, u) is 0-automatic. 

The TE can be solved explicitly. It turns out that there is a unique solution r which is determined 
by: 

p(l-f(b)) l-^i-i pq 1-p-g 

^^"^ l-pf(6) '"^^"^ 2p ' l-p?{by 



According to Theorem 12.51 the corresponding drift is 7 = y^l — Apq. Now, solving the TTE, 
we find a unique admissible solution {p,r), given by: 



A(l -j3r(6)) 
p + Xpr(b) ' 



r . 
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Figure 10: F(a): The solutions to the TTE. 



We have p < 1 iff /u > A7 = Ay^l — 4pq. 

Let us observe what happens when i/(c) tends to 0. When p < 1/2, there is only one solution 
(/9i,ri) for the TTE of the first case. And, as expected, (/?, r) tends to (/?i,ri) when z/(c) — > 0. 
When p > 1/2, there are two possible solutions (/7i,ri) and {p2,r2) for the TTE of the first 
case. In this case, (/), r) tends to {p2,r2) when i>{c) 0. 

In Figure [TT] (left), we plot p and pi as functions of p and X/p., for i/{c) = 0.01. In Figure [TT] 
(right), we plot p and p2- 




Figure 11: {a,b \ ab = 1) and { a,b \ ah = 1) * {c}*: the loads in function of i/(a) and t = X/p. 
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